Probabilistic Model Predictive Safety Certification for Learning-Based Control

نویسندگان

چکیده

Reinforcement learning (RL) methods have demonstrated their efficiency in simulation. However, many of the applications for which RL offers great potential, such as autonomous driving, are also safety critical and require a certified closed-loop behavior order to meet specifications presence physical constraints. This article introduces concept called probabilistic model predictive certification (PMPSC), can be combined with any algorithm provides provable certificates terms state input chance constraints potentially large-scale systems. The certificate is realized through stochastic tube that safely connects current system terminal set states known safe. A novel formulation allows recursively feasible real-time computation tubes, despite possibly unbounded disturbances. design procedure PMPSC relying on Bayesian inference recent advances invariance presented. Using numerical car simulation, method its illustrated by enhancing an certificates.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Linear model predictive safety certification for learning-based control

While it has been repeatedly shown that learningbased controllers can provide superior performance, they often lack of safety guarantees. This paper aims at addressing this problem by introducing a model predictive safety certification (MPSC) scheme for polytopic linear systems with additive disturbances. The scheme verifies safety of a proposed learningbased input and modifies it as little as ...

متن کامل

Data-Efficient Reinforcement Learning with Probabilistic Model Predictive Control

Trial-and-error based reinforcement learning (RL) has seen rapid advancements in recent times, especially with the advent of deep neural networks. However, the majority of autonomous RL algorithms require a large number of interactions with the environment. A large number of interactions may be impractical in many real-world applications, such as robotics, and many practical systems have to obe...

متن کامل

Learning-based model predictive control for Markov decision processes

We propose the use of Model Predictive Control (MPC) for controlling systems described by Markov decision processes. First, we consider a straightforward MPC algorithm for Markov decision processes. Then, we propose value functions, a means to deal with issues arising in conventional MPC, e.g., computational requirements and sub-optimality of actions. We use reinforcement learning to let an MPC...

متن کامل

Nonlinear Model Predictive Control with Probabilistic Models

Nonlinear Model Predictive Control (NMPC) is a powerful control framework, which strongly relies on a good model of the system dynamics. In the case, such a model is not available apriori, non-parametric regression using Bayesian regression or Gaussian Processes (GPs) have been shown promising in inferring the dynamics from collected data. An advantage of Bayesian methods and GPs over other reg...

متن کامل

Probabilistic Model-Based Safety Analysis

Model-based safety analysis approaches aim at finding critical failure combinations by analysis of models of the whole system (i.e. software, hardware, failure modes and environment). The advantage of these methods compared to traditional approaches is that the analysis of the whole system gives more precise results. Only few model-based approaches have been applied to answer quantitative quest...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Automatic Control

سال: 2022

ISSN: ['0018-9286', '1558-2523', '2334-3303']

DOI: https://doi.org/10.1109/tac.2021.3049335